-
Notifications
You must be signed in to change notification settings - Fork 502
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add segment replication + remote store GA information #5037
Conversation
Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
@dreamer-89: This PR is ready for your review. Let me know if there is anything I missed. |
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
…tion/index.md Co-authored-by: Suraj Singh <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]>
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
Co-authored-by: Bukhtawar Khan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]>
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good but we need to reference a consistent name (either remote-backed storage or remote store).
_tuning-your-cluster/availability-and-recovery/remote-store/remote-segment-backpressure.md
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@Naarcha-AWS Please see my comments and changes and let me know if you have any questions. Thanks!
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
As of OpenSearch 2.10, you can use two methods for segment replication: | ||
|
||
- With **remote-backed storage**, a persistent storage solution: The primary shard sends segment files to the remote-backed storage and the replica shards source the copy from the same store. For more information about using a remote-backed storage, see [Remote-backed storage]({{site.url}}{{site.baseurl}}/tuning-your-cluster/availability-and-recovery/remote-store/index/#segment-replication-and-remote-backed-storage). | ||
- Without remote-backed storage: The primary shard sends segment files directly to the replica shards using node-to-node communication. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we call the second method what it is, as opposed to what it isn't? Node-to-node replication?
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
_tuning-your-cluster/availability-and-recovery/segment-replication/index.md
Outdated
Show resolved
Hide resolved
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]>
* Add segment replication + remote store GA information Signed-off-by: Naarcha-AWS <[email protected]> * Add introduction labels Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _tuning-your-cluster/availability-and-recovery/segment-replication/index.md Co-authored-by: Suraj Singh <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Bukhtawar Khan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update index.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Replace Remote Store with Remote Backed Storage Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Suraj Singh <[email protected]> Co-authored-by: Bukhtawar Khan <[email protected]> Co-authored-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>
…ject#5037) * Add segment replication + remote store GA information Signed-off-by: Naarcha-AWS <[email protected]> * Add introduction labels Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _tuning-your-cluster/availability-and-recovery/segment-replication/index.md Co-authored-by: Suraj Singh <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Bukhtawar Khan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update index.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Replace Remote Store with Remote Backed Storage Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Suraj Singh <[email protected]> Co-authored-by: Bukhtawar Khan <[email protected]> Co-authored-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>
* Add segment replication + remote store GA information Signed-off-by: Naarcha-AWS <[email protected]> * Add introduction labels Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _tuning-your-cluster/availability-and-recovery/segment-replication/index.md Co-authored-by: Suraj Singh <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Bukhtawar Khan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update index.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Replace Remote Store with Remote Backed Storage Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Suraj Singh <[email protected]> Co-authored-by: Bukhtawar Khan <[email protected]> Co-authored-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>
Checklist
For more information on following Developer Certificate of Origin and signing off your commits, please check here.